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(54) Moving picture transmission systenn and moving picture transmission apparatus 



(57) There is disclosed a moving picture transmis- 
sion system which enhances the quality of a demand- 
refreshed image without increasing the amount of code 
to be transmitted. When a picture data error has been 
detected, a reception side coder transmits to a transmis- 
sion side decoder information concerning the location 
of the error detected in a picture frame. Upon receipt of 
this information, for several frames, beginning with the 
picture frame that is distorted by the error and continuing 
up until the picture frame preceding the frame to be 
transmitted, the transmission side determines a portion 
that may be distorted by the occurrence of the error or 
by the transmission of the error, and a picture portion 
that may be affected by distortion when picture data are 
to be coded in the inter-frame coding mode. Only the 
picture portion that the transmission side determines will 
be affected is forcibly coded in the intra-frame coding 
picture mode, the other picture portions being coded in 
the normal manner, and the resultant picture data are 
transmitted to the reception side. 
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Description 

REFERENCE TO RELATED APPLICATION 

This application claims the priority right under EPC 
Art. 88 Par 1 . of Japanese Patent Application No. Hei 
07-178684 filed on July 14, 1995. the entire disclosure 
of which is incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to a moving picture 
transmission system, and a moving picture transmission 
apparatus that can be applied, for example, as a de- 
mand refresh system for transmitting compressed mov- 
ing picture data. 

Related Arts 

For digital communication, an enormous amount of 
image data are compressed and redundancies are re- 
moved before the resultant data are transmitted. The 
moving picture coding method that is specified in refer- 
ence document (1), ITU-T Recommendation H. 261 
(TTC Standards (Higher Layer Protocol Coding Method: 
Recommendation JT-H. 261)), is a typical compression 
and coding method.^A/hen this compression method is 
employed.^^a^ifferencelnnime between a current frame 
and a preceding frame is coded (called an Ojte^frame]^ 
coding mode (INTER mode)) to remove redundancies 
in the time axial direction. Or orthogonal transform is 
performed for a picture^thguTcal^lginga^ 
ence^and the resultant data are coded (called an intra- 
frame coding mode (KJjBArnod©)) to eliminate redun- 
dancies in the spacial direction. 

If an error occurs in compressed image data that 
are thus coded, a picture is greatly distorted, and sincli 
*ari^edtff eTence b'el weemh^ 

c&ingJrame_„is_coded. the distortion in the image will 
be transmitted to^ aTsucce ed tng f r aqpe. To cope with such 
an error, according to the above described reference 
document (1 ), a "fast update request" function is provid- 
ed for a system, such as a multi-point conference sys- 
tem, that enables bidirectional communication. 

When ao^erroris^elected at the recegtiomside, a 
fast update request signal is transmitted to the transmis- 
sion sidaUpori the receipt of the signal, ^^oq^Jng devi^ 
at-lhejransm ission side forcjblyxodesTa succ eecliiri 
^icture,_t£;aipf_by employing the inlra:frame Icodjng 
moderand transmits the resuttant dkta. The frame that 
is coded by employing the intra -frame coding mode will 
not be affected by the distortion of the preceding frame. 

A process for coding a single picture frame entirely 
or partially by employing a coding mode that is not af- 
fected by the preceding image distortion and for trans- 
mitting the resultant frame (if the coding method H. 261 



referred to in the reference document (1) is employed, 
this process corresponds to the forcible coding of a sin- 
gle image frame entirely or partially in the intra-frame 
coding mode) is called "^cefiieshing.* and a picture that 
5 is obtained by refreshing is called ^xelrlsJOl^clure. 
T^n^issiOTjjf.a.rekesh.slgnarfiOTvtre 
sion side in response to a update request signal from 
the reception side is called^^aeniao^^ 

<1^3is^ diagram for explaining a conventional de- 
10 mand refresh method. In Fig. 1 , the elapsed time is cal- 
culated from the left to the right as a transmission side 
codes each picture frame and transmits the result to a 
reception side. The area sizes of a shaded square rep- 
resent the amount of code that is to be transmitted for 
'5 a single picture frame. Generally, when coding is per- 
formed only by employing thejntra^framexodi^ 
the amount of code is greater than that which is provided 
when coding is performed by not only employing the in- 
tra-frame coding mode but also emptoying the inter- 

20 frame coding nxxie. 

Supposing that an error is detected when the third 
frame in Fig. 1 is to be decoded, the reception side trans- 
mits a fast update request signal to the transmission 
side. Upon the receipt of the fast update request signal, 

25 the transmission side forcibl y cod es a picture frame to 
be transmitted next ((6e^5xthJframe) by employing the 
intra^frarne-coding rnode. 

Compared with the amount of code that is acquired 
when emptoying the tnter-frame coding mode, there is 

30 a drastic increase in the amount of code that is acquired 
when the intra-frame coding mode is used. When the 
fast update request function, as prepared according to 
the ITU-T Recommendation H. 261 in the reference doc- 
ument (1), is employed for the recovery of a picture that 

35 was distorted because of an error, the entire one picture 
frame must be transmitted by employing the intra-frame 
coding picture mode. If a coding parameter is changed 
to avoid the overflow of a buffer, which is caused by an 
increase in the amount of code while employing the in- 

40 tra-frame coding picture mode, the quantization is per- 
formed roughly, and there is picture deterioration due to 
block distortion. 

SUMMARY OF THE INVENTION 

45 

It is, therefore, an object of the present invention to 
provide a moving picture transmission system, and a 
moving picture transmission apparatus that can perform 
(j emandrefreshin gjor coded moving picture data more 

so efficiently than conventional system and apparatus, 
even though the amount of code to be transmitted is not 
i ncreased and ev enwheri a'^ataerfor occursas a result 
of,an fnfluence encounter^d^torig^iransmissio^ 
nelT ^ tha t^thelquaiity-of-a ptctufe that is decoded can 

55 be-improved. 

To achieve the above object, according to the 
present invention, a moving picture transmission sys- 
tem, which comprises a moving picture transmission de- 
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vice A. for compressing and coding moving picture data 
that are input and for outputting resultant coded moving 
picture data; and a moving picture transmission device 
B, for decoding said resultant coded moving picture da- 
ta, is provided that has the following structure. 

The moving picture transmission device^ of the 
present invention includes an information transmission 
appafBtusJor,„wh^n:^ri^rfwJs^del^ ctela for a 
pictufe-frame that js„obtajn^ by decking the resultant 
c6cfid_nK>vinq'picture data or wheiva picture-range of 
the,resultant_CQded mowng-pjc 
de^^edjs5ele§#b/transmittin^^^ 
transmiss ion d eviceJ^^ fayattty>,of4he error jH gtJs 
tected as.error-de4eclipn^lccation information. ohKej 



Ture rahg^ that-can not be decoded as decoding_dtsg^ 
BTeirangeJnfor^iation . 

The moving picture transmission device A of the 
present invention includes[an^estirnatiorLapparatus. for, 
from the error detection location infornnation or the de- 
coding^isabjed range information that is received, 
tifyHig an error-location inJpjctucilfranrje or ^xii^^ing 
disabled range^andj^jgterrm 

data that is affected by the-errordetected location, or by 
fRe^ecoding disabled range; and refreshed picture 
transmission apparatus for generating refreshed picture 
data by compressing and coding the picture data by em- 
ploying a result obtained by the estimation apparatus 
and tor transmitting the refreshed picture data to the 
moving picture transmission device B. 

According to the present invention, when the mov- 
ing picture transmission device B for performing decod- 
ing detects an error in data for a picture frame, which is 
obtained by decoding the coded moving picture data, 
the moving picture transmission device 8 transmits, as 
an error detected location, the localion of the detected 
e^aLi QIp^mation to the moYinq picture trg^pl^^'ssion de - 
vice A . From the received information, the moving pic- 
ture transmission device A for performing coding iden- 
tifies the error detected location in the picture fram e, and 
determines a portion of picture data that is affected bv 
t be error detection locatip n. The moving picture trans- 
mission device A compresses and codes the picture da- 
ta by employing the estimation result to produce re- 
freshed picture data, and transmits the refreshed picture 
data to the moving picture transmission device B. 

With the thus described arrangement, upon receipt 
of the error detection location information from the de- 
vice for performing decoding, the device for performing 
coding can determine a picture portion that may be af- 
fected by the error on the picture, and can perform re- 
freshing of that portion for transmission. Therefore, 
while the amount of code to be transmitted is not in- 
creased, demand refreshing Is performed more effi- 
ciently than it is conventionally, even it a data error oc- 
curs as a result of an influence encountered along a 
transmission channel, so that the quality of the decoded 
picture can be improved. 

The moving picture transmission device 8 for per- 



forming decoding detects a picture range of coded mov- 
ing picture data that can not be decoded, and transmits 
to the nr>oving picture transmission device A the picture 
range as decoding disabled range information. Up>on re- 

5 ceipt of this information, the moving picture transmission 
device A identifies the decoding disabled range, and de- 
termines an affected portion of the picture data by the 
decoding disabled range. The moving picture transmis- 
sion device A compresses and codes the picture data 

10 by employing the estimation result, produces refreshed 
picture data, and transmits the data to the moving pic- 
ture transmission device B. 

With this arrangement, since, upon receipt of de- 
coding disabled range infornr^tion from the device for 

'5 decoding, the device for coding can determine a picture 
portion that may be affected by the decoding disabled 
range and can transfer a refreshed picture portion, the 
amount of code to be transmitted is not increased, and 
demand refresh can be performed more efficiently than 

20 it is conventionally, even If a data error occu rs as a result 
of an influence encountered along a transmission chan- 
nel, so that the quality of the decoded picture can be 
improved. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a diagram for explaining a conventional de- 
mand refresh method; 

Fig. 2 is a diagram for explaining a demand refresh 
30 system according to a first embodiment of the 
present invention; 

Fig, 3 is a functional diagram illustrating a moving 

picture coder according to the first embodiment; 

Fig. 4 is a functional diagram illustrating a moving 
35 picture decoder according to the first embodiment; 

Fig. 5 is an explanatory diagram for the hierarchiat 

divisions of moving picture data; 

Fig. 6 is a diagram for explaining the process for the 

first embodiment by which a transmission side de- 
40 termines portions that may be affected by errors in 

frames A through D; 

Fig. 7 is a diagram for explaining the process for the 
second embodiment by which the transmission side 
determines portions that may be affected by errors 

45 in frames A and B; 

Fig. 8 is a diagram for explaining the process for the 
second embodiment by which the transmission side 
determines portions that may be affected by errors 
in frames C and D; 

50 Fig. 9 is an explanatory diagram for a demand re- 
fresh system according to a third embodiment; and 
Fig. 10 is a diagram for explaining the process for 
the third embodiment by which a transmission side 
determines portions that may be affected by errors 

55 in frames A through D. 
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DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

The preferred embodiments in which the present in- 
vention is applied as a moving picture demand refresh 
system will now be described while referring to the ac- 
companying drawings. According to the embodiments, 
in a demand refresh method, according to which one 
moving picture frame is divided into regions having spe- 
cific sizes and data for each divided region are coded 
and the coded data are transferred, and according to 
which the reception side decodes the coded moving pic- 
ture data that are received and notifies the transmission 
side if an error has occurred, and the transmission side 
transmits a refreshed picture that is not affected by the 
error, the r^rfiptipp sirifi tr^iqRmitR, as a notice of an error 
to the transmission side, infornr fation concerniruiarLje r- 
ror location in a picture fram e. The t ff^n<^mLg;sian <;irip rit^ - 
termines ^ortion that may be affected by jhe error and 
refreshes th at port ion, and t hereafter transmits the r e- 
fresh ed portion. 

Further, in a demand refresh method, according to 
which one moving picture frame is divided into regions 
having specific sizes and data for each of the divided 
regions are coded and the coded data are transferred, 
and according to which the reception side decodes the 
coded moving picture data that are received and notifies 
the transmission side if an error has occurred, and the 
transmission side transmits a refreshed picture that is 
not affected by the error, the reception side transmits to 
the transmission side, as notification of an error, infor- 
mation concerning a portion of the picture frame that the 
reception side could not decode. Tj;ir trnns xiiission side 

delerminfiS_a POrtio n^thf^lt may ho p^fff^^tf>|H Jay4fao ^rrr^r 

a nd refreshes that p ortion, and ther^^fifir trarnfirr^j^gjhf^ 
refreshed portion. 

In aounionT vyherCthe transmission siOel TiasC fe^- 

ceiviBcirtfie^rror locatiorTrnformatron. as notification' of' 

{\ ( r''" ^— — ' — — — 

.an^rror, from the recep^ion^side, t he transmission side 

e mploys the search ranpe of a motion ypotrtr | gr codin g 
t he movinQ_picture^t o e stimate the_extent of a portio n 
I t hat may be affected by the erro r. Further, for the coding 
' of a moving picture, the transmission side stores infor- 
mation indicating whether a region is coded or not, and 
,upon the receipt of. as an error notice, of the error loca- 
'tion information from the reception side, the transmis- 
sion side employs the stored information concerning the 
/coded region to estimate the extent of a portion that may 



Lbyi thee rfor. 

(First embodiment] 

Fig. 2 is a diagram for explaining a demand refresh 
system according to a first embodiment of the present 
invention. In Fig. 2, it is assumed that the elapsed time 
is calculated from the left to the right, and a moving pic- 
ture coding and decoding device on the transmission 
side codes each picture frame and transmits the coded 



frame to the reception side. The dimension of each 
shaded rectangle represents the anrx>unl of code that is 
to be transmitted for a corresponding picture frame. The 
moving picture coding and decoding device on the 
5 transmission side includes a moving picture coder 1a 
and a moving picture decoder 1 b, and a moving picture 
coding and decoding device on the reception side has 
a moving picture coder 2a and a nnoving picture decoder 
2b. Although, according to a conventional demand re- 
fresh method, when an error is detected, the reception 
side transmits to the transmission side a fast update re- 
quest signal as an error notice, in the first embodiment, 
information M concerning a detected error location in 
one picture frame is transmitted as an error notice from 

'5 the reception side moving picture coder 2a to the trans- 
mission side moving picture decoder lb. 

When the moving decoder lb on the transmission 
side has received the information M concerning the error 
location, for several frames (three frames in Fig. 2), up 

20 until a picture frame that precedes a frame that is to be 
transmitted, the transmission side determines picture 
portions that may be distorted by the error or by the 
transmission of the error, and the picture portions that 
may be affected by such distortion when they are the 

25 next to be coded in the inter-frame coding mode. Then, 
only the picture portions that the transmission side as- 
sumes to be affected are forcibly coded in the intra- 
frame coding picture mode, and the other picture por- 
tions are coded in the normal manner. 

30 

(Structures of moving picture coders la and 2a): 

Fig. 3 is a functional diagram for a moving picture 
coder. In Fig. 3, the moving picture coder is constituted 

35 of a source coder 201; a video multiplex coder 202; a 
transmission buffer 203; a transmission coder 204; a 
coding control 205; and an error location information 
transmission circuit 206. 

Video signals, which are original data for moving 

"to pictures, are represented by the GIF (Common Interme- 
diate Format) and the QCIF (Quarter GIF (1/4 CIF)). To 
code the moving picture data, the data are divided in a 
hierarchial manner into a GOB (Group Of Blocks), a 
macroblock and an 8 x 8 pixel block, as is shown in Fig. 

<5 5 for explaining the hierarchial divisions of moving pic- 
ture data. The numbers (CIF: 1 through 12. QCIF: 1, 3. 
5) in pictures indicate GOB numbers; numbers (1 
through 33) in the GOB indicate macroblock addresses; 
and numbers (1 through 6) in the macroblock indicate 

50 block numbers. The numbers (8) beside the block indi- 
cate the number of pixels for each side of a block. 

In the moving picture coder la. an input video signal 
is coded by source coder 201. The source coder 201 
first estimates the motion between frames for each mac- 

55 roblock. The source coder 201 then performs orthogo- 
nal transform of a prediction error for each block, and 
quantizes the result. The prediction process is normally 
performed in the inter-frame coding mode; however, at 
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the time ol a change of scenes, original data for a mov- 
ing picture is employed lor orthogonal transform (intra- 
frame coding mode). Whether orthogonal transform 
should be performed for the prediction error for motion 
compensation between frames (inter-frame coding 
mode), or for the original data of a moving picture (intra- 
frame coding mode) is determined by comparing vari- 
ance of prediction error with those of the original data. 

It is preferable that a nrKxJe for reducing the amount 
of code can be selected. In prior art, when a fast update 
request signal is received, the succeeding picture frame 
i s coded in the intra -frame coding mode. ^KffSElIS^r 
hano^Bitffe^iV!sife mDQginf?5^l5fMhW^p!rWsV^ 

th^tTn'a]pB ^?f5SeaTy8i§!Smmau?t 
riSSv^?^ ndt|^^ 

A DCT (Discrete Cosine Transform) is employed for 
orthogonal transform, by which data that are expressed 
by using pixel regions are transformed to data that are 
expressed by using frequency regions. The data that are 
now expressed by using frequency ranges and quan- 
tized are supplied to the video multiplex coder 202. The 
video multiplex coder 202 performs variable length cod- 
ing of the data that are coded by the source coder 201 , 
and further multiplexes header information. 

The header information is constituted of a frame 
header (picture start code (a synchronous code for ac- 
quiring synchronization), a temporal reference, picture 
type information, and spare information), a GOB header 
(a GOB start code (a synchronous code for acquiring 
synchronization), a GOB number, quantizer information, 
and spare information), and a macroblock header (mac- 
roblock address, macroblock type information, quantiz- 
er information, a motion vector information, and a coded 
block pattern). 

The data that are respectively coded and multi- 
plexed by the source coder 201 and the video multiplex 
coder 202 are transmitted to the transmission buffer 
203. The transmission buffer 203 is a memory circuit for 
maintaining a constant transmission speed. The trans- 
mission buffer 203 informs the coding control 205 of the 
state of the buffer. The coding control 205 provides a 
control signal to the source coder 201 to instruct the 
change In the amount of generated information. Further, 
the coding control 205 supplies a control signal to the 
video multiplex coder 202 so as to provide the content 
of the instruction concerning the change in the amount 
of information that is generated, and so as to control the 
volume of the data flow to the transmission buffer 203. 

The transmission buffer 203 reads multiplexed data 
at a required time and transmits them to the transmis- 
sion path coder 204. The transmission coder 204 inserts 
a dummy bit into the transmission buffer 203 when it is 
empty., and adds an error correction signal to the output 
of the transmission buffer 203, and outputs a coded bit 
sequence. 

When the error location information transmission 
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circuit 206, of the nnoving picture coder 2a on the recep- 
tion side, that is the feature of the present invention, re- 
ceives an error detection signal (including informatran 
concerning an error location) from the reception side 
moving picture decoder 2b, the error k^cation infornoa- 
tion transmission circuit 206 outputs error location infor- 
mation. The error location information may be output via 
the transmission coder 204 or may be output directly to 
a transmission channel. 

In the first emlxxiiment, upon receipt of the error 
kx:ation infornnation from the reception side, the trans- 
mission side predicts what portion of a decoded image 
frame may be affected by distortion due to an error. 
(Structures of moving picture decoders 1 b and 2b): 

Fig. 4 is a functional diagram illustrating moving pic- 
ture decoders lb and 2b. In fig. 4. each moving picture 
decoder is constituted of a receiving decoder 207, a re- 
ceiving buffer 208, a video multiplex decoder 209, a 
source decoder 210, an error location information re- 
ceiving circuit 211 . and an error affected region estima- 
tion circuit 212. 

The receiving decoder 207 receives a coded bit se- 
quence from the moving picture coder 1a or 2a and re- 
moves a dummy bit. Also, the receiving decoder 207 ex- 
amines the bit sequence to determine whether or not an 
error is present, and when an error is found, the decoder 
207 corrects the error and sends the result to the receiv- 
ing buffer 208. The receiving buffer 208 is a memory 
circuit for guaranteeing a period of time for decoding the 
received data, and provides the received data to the vid- 
eo multiplex decoder 209 at a desired time. 

Taking the hierarchial structure into consideration, 
the video multiplex decoder 209 performs variable 
length decoding to extract the compressed data, and 
transmits the decoded data to the source decoder 210. 
When the video multiplex decoder 209 extracts the com- 
pressed data, contradictions might occur due to an error 
that can not be corrected by the receiving decoder 207 
(for example, a data string that is not present on a var- 
iable length coding table is extracted), and as a result 
decoding might be impossible. When the decoding can 
not be performed, the video multiplex decoder 209 out- 
puts an error detection signal (including information con- 
cerning an error location). 

The source decoder 210 performs computation for 
expanding the compressed data, more specifically, it 
performs inverse quantization and motion compensa- 
tion, and reproduces resultant video signals on a display 
device. TiheTeTrO TilGgatiiM ^jjj^^ 
241J(j ^^wt^ietal^smtbe J^f,^j^^l^^l^j^ re- 
ce'fvesjg^G yt^g tiefii^ eire.^Byg>l^ifete 
^^ipyin^pSto^fegderj^and tr ^ thisl iRtSfHi^itiEin^to 
the e rror aff^ ^^^^taff S?!rTBB5fff^fBi!^2^ 2. The error 
location in^^SSSRfFfat is sent.frgririltf(i^r.gsgption side 
vinoDict 
: ^^20 
mat i3BifeeSKf!^^rcui^|I4 . 

The error aff ^'ciSSffSfejionTestimat ion circuit 212 em- 



mo ving pic li?f5%oder mav ji^ejiletched by^tbj ByieceivinQ 
dec€SSP2b7 and transmittSbil&iniBTeT¥o'f''i&cation infor- 
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ploys th e.,g f f Of -focat ion information to-determine a por- 
tion that may be af^ted by distonian due to an<errpr. 
and transmits the predic ts j oformation to^tBejrioving 
picture coder, which ir^tunvcodes, in the intra^franne 
coding mode, a picture^p^rttbn that may be affected-by 
thcdistbrtion. 

Fig. 6 is a diagram for explaining the estimation 
process performed by the transmission side to deter- 
mine portions that are affected by an error. In Fig. 6. por- 
tions that are expected to be affected by the transmis- 
sion side are represented by shades 51 and dots 52. 
The coded data are arranged in ascending order ac- 
cording to the GOB numbers, the macroblock address- 
es and the block numbers, and are transmitted. A syn- 
chronous code is inserted between the individual GOBs 
for synchronization. 

Therefore, when an error is detected at the picture 
location as is shown in Fig. 6(a), and if the next synchro- 
nous code is detected correctly it is assumed that the 
shaded portion 51 of the picture frame A can not be de- 
coded at the reception side. Since the variable length 
coding has been performed, once an error is detected, 
a decoding process can not be performed until the syn- 
chronous code that appears next is obtained. 

In this embodiment, for a portion that can not be de- 
coded at the reception side, the identical portion in the 
preceding frame is displayed. When an error is detected 
at ihe reception side, the error location information is 
forwarded, to the transmission side, as the information 
for GOB number 5 and macroblock address 21 , for the 
case shown in Fig. 6(a). 

According to the coding method that is specified by 
the ITU-T Recommendation H. 261 in the reference doc- 
ument (1), a motion vector for motion compensation is 
limited to a range of +1 5 to -1 5 pixels vertically and hor- 
izontally Therefore, at most a doited portion 52 in Fig. 
6(b) in the succeeding image frame B may be affected 
by the shaded portion 51 shown in Fig. 6(a). Further, a 
portion in the succeeding frame C that may be affected 
is the one represented by dots 53 in Fig. 6(c). 

In this manner, an estimation of what picture portion 
may be distorted is made at the transmission side and 
is indicated by the fine shading 54 in Fig. 6(d). When the 
next frame that the transmission side is to code after 
receiving the error location information is frame D. the 
picture distorted portion 54 is coded in the intra-frame 
coding mode. In addition, when the other portions are 
to be coded in the inter-frame coding mode, a portion (a 
roughly shaded portion 55 in Fig. 6(d)) that may be af- 
fected by the portion 54 is also coded in the intra-frame 
coding mode. 

(Operation): 

The demand refresh operation will now be ex- 
plained while referring to Figs. 2, 3 and 4. First, at the 
transmission side moving picture coding and decoding 
device, a moving picture is coded by the moving picture 
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coder la. and image data for the first through sixth 
frames are output via the transmission coder 204 to the 
transmission channel. The reception side moving pic- 
ture coding and decoding device uses the moving pic- 
ture decoder 2b to receive and decode the image data 
in order, beginning with those for the first frame. Sup- 
pose that the third frame is received as shown in Fig. 2 
and is regarded as frame A, When an error is detected 
in the image data, the error location information trans- 
mission circuit 206 in the reception side moving picture 
coder 2a transmits, to the transmission side rrraving pic- 
ture decoder lb. a GOB number and a macroblock ad- 
dress of an error location in frame A. 

CSuHe transmission side moving picture decoder 1 b, 
ie error location information receiving circuit 211 re- 
eives the error location information. Upon receipt of this 
iformation, the error location is detected and is sent to 
le error affected region estimation circuit 21 2. The error 
iffected region estimation circuit 212 employs the error 
Jcation information to determine the error affected re- 
gpn, and transmits an error affected region estimation 
signal to the moving picture coder 1 a. Consequently, the 
XKiing control 205 forcibly codes, in the intra-frame cod- 
ng mode, a picture portion corresponding to the error 
affected region that is obtained by the estimation that is 
m ade based on the error affected region estimation sig- 
iial. The coding control 205 codes the remaining picture 
pcrtions in the inter-frame coding mode or in the intra- 
irc me coding mode. The resultant coded data are trans- 
rpmed to the reception side as the sixth frame in Fig. 2. 
■pe reception side receives it as frame D. performs re- 
freshjag^on a picture for which the error has been de- 
Qgcled-and displays the refreshed picture. 

According to the demand refresh system in the first 
embodiment, when the transmission side has received 
error location information, it does not always send the 
entire picture frame in the intra-frame coding mode, and 
can reduce the amount of code to be transmitted in order 
to recover the image from the distortion that is due to 
the error Since the amount of code can be decreased, 
finer quantization can be performed, and deterioration 
of the image, such as block distortion, can be reduced. 

More specifically, when a motion vector search 
range is used in moving picture coding, the transmission 
side moving picture coding and decoding device can 
more accurately determine error affected regions. 

The transmission side moving picture coding and 
decoding device performs intra-frame coding for an im- 
age data portion that it is assumed to be affected, and 
performs inter-frame coding or intra-frame coding for the 
remaining image portions, so that the amount of coded 
data is not increased. 

Therefore, it is possible to provide a moving picture 
transmission system and a moving picture transmission 
apparatus which can perform demand refresh more ef- 
ficiently than it is conventionally, even though the 
amount of coded moving picture data to be transmitted 
is not increased and even if a data error occurs as a 
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result ot an influence encountered along a transmission 
channel, so that the quality of decoded images can be 
enhanced. 

[Second embodiment] 

Likewise, in a second embodiment, when the trans- 
mission side has received error location information M 
from the reception side, it determines which picture por- 
tion may be affected by the error and forcibly codes the 
picture portion in the intra-f rame coding mode, as shown 
in Fig. 2. It should be noted that a difference from the 
first embodiment is the method used for determining the 
image portion affected by the error. According to the 
method used for the second embodiment, one part of 
the frame information that was previously coded by the 
transmission side remains at the transmission side. 
When the transmission side has received error location 
information, it uses that information to reduce the size 
of a portion that is to be coded in the inlra-frame coding 
mode even more than it is reduced by the first embodi- 
ment. 

The moving picture coder according to the ITU-T 
Recommendation H. 261 in reference document (1) 
does not transfer macroblock information when there is 
no information in the macroblock. i.e., when a motion 
vector is zero and all transform coefficients are zero. In 
the second embodiment, therefore, infornnation about 
whether data are present or absent in the macroblock 
remains as COD (CODed indication) information on the 
transmission side. Then, the COD information for all the 
image frames is used at the transmission side when the 
estimation is made as to of which image portions may 
be affected by the error. 

The COD information that is required is equivalent 
to the number of frames that are received by the recep- 
tion side from the time it transmitted the error location 
information up until it receives refreshed images, i.e., 
the number of frames F from frame A through frame C 
in Fig. 2. The COD information for only the latest F 
frames remains, and the COD information for older 
frames is abandoned. 

Supposing that 0 is left when data are present in the 
macroblock and 1 is left when data are absent, data bits 
B which are maintained at the transmission side are, at 
most, set forth: 

B = [macroblock count per frame] x F (1 ) 

wherein F denotes the number of frames that are re- 
ceived during a period from the time of the transmission 
of the error location information up until the time of the 
receipt of the refreshed picture. 

For an example shown in Fig. 2 with a picture in the 
CIF format, the latest COD information of only (33 x 1 2) 
X 3 = 1188 bits need remain on the transmission side. 
Accordingly, the hardware k>ad of the moving picture 



coder can be considerably reduced. 

Figs. 7 and 8 are diagrams for the estimation at the 
transmission side of ranges that may be affected by an 
error. In (a1). (b1). (c1) and (d1). on the left, in Figs. 7 
5 and 8 are shown COD information that is left on the 
transmission side, and in (a2). (b2), (c2) and (d2), on 
the right, are shown shaded portions, determined by the 
transmission side, that may be affected by the error. 
As is shown in Fig. 2, when an error is found in frame 
'0 A on the reception side and is detected at location 71 , 
which is indicated by an X in (a2) in Fig. 7, GOB number 
5 and macroblock address 21 are transmitted as error 
kx:ation information from the reception side to the trans- 
mission side. When a synchronous code between the 
'5 GOBs is correctly detected, a portion that can not be 
decoded by the detected error corresponds to a shaded 
portion 73. 

In the same manner as in the first embodiment, the 
identical portion in the preceding frame is displayed for 
the portion that can not be decoded at the reception 
side. It can be determined by using the COD information 
((a1 ) in Fig. 7) that remains on the transmission side that 
distortion has occurred only in macroblocks 74 wherein 
data are present. Thus, a portion, determined by the 
transmission side, that can not be decoded at the recep- 
tion side is smaller than that in the first embodiment. 

As well as for the first embodiment, since a motion 
vector is limited to a range of ± 15 pixels vertically and 
horizontally, the portion that may be affected by the error 
when the reception side decodes the next image frame 
B is a region 72 in (b2) in Fig. 7. Since the COD infor- 
mation ((b1 ) in Fig. 7) for the frame B is also maintained 
on the transmission side, it can be determined by using 
the COD information that the error does not affect a 
macroblock wherein no data are present. Further, the 
range of a motion vector and the COD information of the 
frame C are used in the same manner, so that a region 
81 in (c2) in Fig. 8 corresponds to a portion that may be 
affected by the error Thus, only a region 82 in (d2) in 
Fig. 8 is required to be forcibly coded in the intra-f rame 
coding mode when the error location information is sent 
to the transmission side. 

According to the demand refresh system of the sec- 
ond embodiment, when error location information is re- 
ceived by the transmission side, not all of the macrob- 
locks in the succeeding picture frame are necessarily 
transmitted in the intra -frame coding mode. Only one 
part needs to be coded in the intra-frame coding mode, 
and as a result, the amount of code to be transmitted 
can be reduced. As the amount of code is reduced, finer 
quantization can be performed and deterioration of the 
picture, such as block distortion, can be reduced. Since 
only a small amount of information needs to be re- 
mained on the transmission side, the hardware load is 
small- 
More specifically, in addition to the advantages of 
the first embodiment, to perform the compression and 
the coding of a moving picture, the moving picture cod- 
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ing and decoding device includes nneans for storing, for 
each predetermined region (macroblock). information 
concerning whether or not coded data is present (veri- 
fying the presence or absence of data by using the COD 
information). Further, the moving picture coding and de- s 
coding device employs the above COD information to 
determine an error affected region, so that an assump- 
tion of the error affected region can efficiently and accu- 
rately be made. 

It is therefore possible to provide a moving picture w 
transmission system and a moving picture transmission 
apparatus that can perform demand refreshing more ef- 
ficiently than it is performed conventionally, though the 
amount of code for rrxjving picture data that are to be 
transmitted is not increased and even if a data error oc- '5 
curs as a result of an influence encountered along a 
transmission channel, so that the quality of a decoded 
image can be enhanced. 

[Third embodiment]: 20 

Fig. 9 is a diagram for explaining a demand refresh 
system according to a third embodiment of the present 
invention. As in Fig. 2, the elapse of time is calculated 
from the left to the right, and a transmission side codes 25 
each picture frame and transmits the coded frame to the 
reception side. The dimension of each shaded rectan- 
gular represents the amount of code that is to be trans- 
mitted for one picture frame. 

In the first and the second embodiments, informa- 30 
tion M for error detected location in one picture frame is 
transmitted as an error notification. In the third embod- 
iment, information N for a picture portion (range) that 
can not be decoded by the reception side is transmitted 
as an error notification. 35 

Further, in this embodiment, when the transmission 
side has received the information N for the picture por- 
tion that can not be decoded by the reception side, for 
several frames beginning with the picture frame that is 
distorted by the error and continuing up to the image 40 
frame preceding the frame that is to be transmitted, i.e., 
for the three frames (frames A through C) in Fig. 9. the 
transmission side determines which picture portion may 
be distorted by the error or by the transmission of the 
error, and which image portion may be affected by dis- 
tortion when coding is to be performed in the inter-frame 
coding mode. Only the picture portions that the trans- 
mission side determines it to be affected are forcibly 
coded in the intra-frame coding mode. The other image 
pwDrtions are coded in a normal manner. so 

Moving picture coders 1 a' and 2a' in the third em- 
bodiment are designed almost the same as those in the 
first and the second emlxxiiments. As the feature of 
these coders in this embodiment, the information N that 
is sent from the reception side as the disabled decoding 55 
picture portion is employed by the transmission side to 
determine the portion, within the picture frame that is 
decoded by the reception side, that may be affected by 
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distortion due to the error. 

Fig. 10 is a diagram for explaining the estimation 
process performed by the transmission side to deter- 
mine portions that may be affected by the error. In Fig. 
10, portions that are assurned to be affected portions 
are represented by shades and dots. Coded data are 
arranged in ascending order according to the GOB num- 
bers, the nnacroblock addresses and the block numbers, 
and are transmitted. A synchronous code is inserted be- 
tween the GOBs for synchronization. In Fig. 10(a) is 
shown an example wherein an error was detected and 
the succeeding synchronous code can not be correctly 
detected. At this time, it is assumed that a shaded por- 
tion 101 in picture frame A is not decoded by the recep- 
tion side. 

As well as in the first and the second embodiments, 
for the portion that can not be decoded by the reception 
side, the identical portion of the preceding frame is dis- 
played. Once an error is detected by the reception side, 
information concerning the picture portion that can not 
be decoded by the reception side (hereinafter referred 
to as "decoding disabled range information"), i.e., from 
GOB number 5 and macroblock address 21 to GOB 
number 6 and macroblock address 33 in Fig. 10(a), is 
transmitted to the transmission side. As in the first em- 
bodiment, since the motion vector for motion compen- 
sation is limited to a range of ± 15 pixels vertically and 
horizontally, a dotted portion 102 in Fig. 10(b) corre- 
sponds to a portion in succeeding image frame B that 
may be affected by the shaded portion 1 01 in Fig. 1 0(a). 

Further, a picture portion in the next image frame C 
that may be affected is a dotted portion 103 in Fig. 10 
(c). In the same manner, a picture portion that may be 
distorted is determined by the transmission side as 
shown as a portion 1 04 that is represented by fine shad- 
ing in Fig. 10(d). When succeeding frame D is coded by 
the transmission side upon receipt of the decoding dis- 
abled range information, the portion 104 is coded in the 
intra-frame coding mode. In addition, a roughly shaded 
portion 105 in Fig. 10(d), which will be affected by the 
portion 104 when the other portions are coded in the 
inter-frame coding mode, is coded in the intra-frame 
coding mode. 

According to the demand refresh system of the third 
embodiment, the same advantages can be achieved as 
are obtained by the first embodiment. Further, when the 
information for the picture portion that can not be decod- 
ed by the reception side is received by the transmission 
side, not all the macroblocks in the succeeding picture 
frame are necessarily transmitted in the intra-frame cod- 
ing mode. Only one part of the nnacrobtocks needs to 
be coded in the intra-frame coding mode. 

The difference between the third embodiment and 
the first and the second embodiments is that a picture 
portion that may be erroneously transmitted can be re- 
freshed even though a synchronous code that immedi- 
ately follows the error detected location can not be de- 
tected. 



8 



15 



EP 0 753 968 A2 



16 



More specifically, tha4yansniiss:on-side moving pic- 
ture codina_and decoding device esttmdtesi the error af- 
fected regionbyjutili^&tga motjon ^vector ^sea fetLran^e 
for moving^xture^coding, andUhus-the accuracy^of^e 
estirrtato rcafTb ejrnproved. 5 

The transmission side moving picture coding and 
decoding device performs intra-frame coding for the 
predicted image data portion, and performs inter-frame 
coding or intra-frame coding for the other picture por- 
tions, so that the amount of coded infornnation will not io 
be increased. 

Therefore, for the transmission of coded moving 
picture data, it is possible to provide a nnoving picture 
transmission system and a moving picture transmission 
apparatus that can perform demand refreshing more ef- '5 
ficientty than it is performed conventionally without the 
amount of code to be transmitted being increased, even 
if a data error occurs as a result of an influence encoun- 
tered along a transmission channel, so that the quality 
of a decoded image can be improved. 20 

(Other embodiments]: 

(1) In the first trough the third embodiments, the 
coding method described in ITU-T Recommenda- 25 
tion H. 261 in reference document (1 ) has been em- 
ployed as an example. Another method, including 

the divisions of a picture frame and the range of a 
motion vector, can be employed. 

(2) In the first and the second embodiments, it's as- 30 
sumed that the synchronous code that immediately 
follows the error detected location can always be 
acquired. Since 'a synchronous code can not be ac- 
quired" is included in "an error has been detected, 

" information for the location at which the synchro- 35 
nous code could not be acquired may be transmit- 
ted as an error notification to the transmission side. 
In other words, under the condition in Fig. 6(a), GOB 
number 5 macrobtock address 21 and GOB number 
6 macroblock address 1 are transmitted as error lo- 40 
cation information to the transmission side. 

If a plurality of error locations are transmitted 
as error notices per one picture frame from the re- 
ception side to the transmission side, image data 
can be satisfactorily refreshed even though the syn- 45 
chronous code that immediately follows the error 
detected location can not always be acquired. 

(3) In addition, in the same manner as the second 
embodiment is developed from the first embodi- 
ment by using the COD information, in the third em- so 
bodiment, COD infornr^tion is retained in the trans- 
mission side to reduce a portion to be refreshed. 

(4) Further, the moving picture decoders lb and 2b 
include the error affected region estimation circuit 

21 2 in Fig. 4. For another embodiment, the error af- 55 
fected region estimation circuit 21 2 can be included 
in the moving picture coders la and 2a. The same 
advantage can be so obtained as is acquired when 



an error affected region is determined and coding 
control is performed by using the error location in- 
formation of the error location information receiving 
circuit 211 of the moving picture decoder lb or 2b. 

(5) In the above embodiments, the picture coding 
method described in ITU-T Recommendation H. 
261 has been employed, and the present invention 
can be applied to MPEG-l, which is a moving pic- 
ture coding method for storage media (e.g., video 
CD). More specifically, the present invention can be 
applied tor a DV-I (Digital Video Interactive) that is 
based on CD-ROM. Further, the present invention 
can be applied to a television conference system 
and a television telephone system. 

(6) Furthermore, the present invention can be used 
for MPEG-2, which is a media integration picture 
coding method, and more specifically, for a digital 
HDTV system. 

As is described above, according to the present in- 
vention, a moving picture transmission device for de- 
coding includes information transmission means that, 
when an error is detected in picture frame data that are 
obtained by decoding coded moving picture data, or 
when a disabled decoding image range for the coded 
moving picture data is detected, transmits the error de- 
tected location as error detected location information or 
the disabled decoding image range as decoding disa- 
bled range information to the moving picture transmis- 
sion device for coding. Further, the moving picture trans- 
mission device for coding includes the estimation 
means, which identifies the error detected location in the 
picture frame by using the received error detected loca- 
tion information, or the decoding disabled range by us- 
ing the received decoding disabled range information, 
and which determines a picture portion that may be af- 
fected by the identified error detected location or by the 
picture data in the decoding disabled range, and the re- 
freshed picture transmission means, which compresses 
and codes the picture data by using the result obtained 
by the estimation means to produce refreshed picture 
data, and transmits the refreshed picture data to the 
moving picture transmission device for decoding. As a 
result, a moving picture transmission system and a mov- 
ing picture transmission apparatus can be provided 
wherein the amount of code to be transmitted is not in- 
creased, and demand refreshing is performed more ef- 
ficiently than it is performed conventionally even if a da- 
ta error has occurred as a result of an influence encoun- 
tered along a transmission channel, so that the quality 
of a decoded picture can be improved. 



Claims 

1. A moving picture transmission system comprising: 
a first moving picture transmission device for 
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compressing and coding nr»oving picture data 
that are input and foroutpulting resuflant coded 
moving picture data; and 
a second moving picture transmission device 
for decoding said resultant coded moving pic- s 
ture data; 

said second moving picture transmission de- 
vice including information transmission means 
for. when an error is detected in data for a pic- 
ture frame that is obtained by decoding said re- 10 
sultant coded moving picture data, transmitting 
to said first moving picture transmission device 
a location of said error that is detected as error 
detection location information; 
said first moving picture transmission device in- is 
eluding estimation means, for, from said error 
detection location information that is received. 
Identifying an error location in a picture frame 
and for making an estimation as to which pic- 
ture data portion by said error detected location 20 
Is affected; and refreshed picture transmission 
means for generating refreshed picture data by 
compressing and coding said picture data by 
employing a result obtained by said estimation 
means and for transmitting said refreshed pic- 25 
ture data to said second moving picture trans- 
mission device. 

2. A moving picture transmission system according to 
claim 1 . wherein said estimation means of said first 30 
moving picture transmission device employs a mo- 
tion vector search range for moving picture coding 
when making said estimation concerning said pic- 
ture data portion. 

35 

3. A moving picture transmission system according to 
claim 1 or 2, wherein, for compression and coding 
of moving pictures, said first moving picture trans- 
mission device further includes coded indication in- 
formation memory means for storing, for each pre- 40 
determined region, information concerning whether 

or not coded information is present, and wherein 
said estimation means employs said coded indica- 
tion information for estimation. 

45 

4. A moving picture transmission system according to 
claim 1 , 2 or 3, wherein said first moving picture 
transmission device performs intra-frame coding for 
data for said picture portion that is determined, and 
performs inter-frame coding or intra-frame coding so 
for all remaining picture portions. 

5. A moving picture transmission system comprising: 

a first moving picture transmission device for 55 
compressing and coding moving picture data 
that are input and for outputting resultant coded 
moving picture data; and 




968 A2 18 

a second nnoving picture transmission device 
for decoding said resultant coded moving pic- 
ture data; 

said second moving picture transmission de- 
vice including information transmission means 
for. when a picture range of said resuftant cod- 
ed moving picture data that cannot be decoded 
is detected, transmitting to said first moving pic- 
ture transmission device said picture range that 
can not be decoded as decoding disabled 
range information; 

said first moving picture transmission device in- 
cluding estimation means, for. from said decod- 
ing disabled range information that is received, 
identifying a decoding disabled range and for 
making an estimation as to which picture data 
portion by said decoding disabled range is af- 
fected; and refreshed picture transmission 
means for generating refreshed picture data by 
compressing and coding said picture data by 
employing a result obtained by said estimatbn 
means and for transmitting said refreshed pic- 
ture data to said second moving picture trans- 
mission device. 

6. A moving picture transmission system according to 
claim 5, wherein said estimation means of said first 
moving picture transmission device employs a mo- 
tion vector search range for moving picture coding 
when making said estimation concerning said pic- 
ture data portion. 

7. A moving picture transmission system according to 
claim 5 or 6, wherein, for compression and coding 
of moving pictures, said first moving picture trans- 
mission device further includes coded indication in- 
formation memory means for storing, for each pre- 
determined region, information concerning whether 
or not coded information is present, and wherein 
said estimation means employs said coded indica- 
tion information for estimation. 

8. A moving picture transmission system according to 
claim 5. 6 or 7, wherein said first moving picture 
transmission device performs intra-frame coding for 
data for said picture portion that is determined, and 
performs inter-frame coding or intra-frame coding 
for all remaining picture portions. 

9. A moving picture transmission apparatus, for de- 
coding coded moving picture data, comprising: 

Information outputting means for. when an er- 
ror is detected In data for a picture frame that is ob- 
tained by decoding said coded moving picture data, 
outputting a location of said error that is detected 
as error detection location Information. 

10. A moving picture transmission apparatus, for de- 
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coding coded moving picture data comprising: 

information outputting means for, when a pic- 
ture range of said cxjded moving picture data that 
can not be decoded Is detected, outputting said im- 
age range that can not be decoded as decoding dis- s 
abled range information. 

11. A moving picture transmission apparatus, for com- 
pressing and coding a moving picture and for out- 
putting coded moving picture data, comprising: 10 

estimation means, for. upon receipt of error de- 
tection location infomiation obtained by a de- 
coding side during decoding of said coded mov- 
ing picture data, identifying an error location in '5 
a picture frame, and for making an estimation 
as to which innage data portion by said error de- 
tected location is affected; and 
refreshed picture transmission means for gen- 
erating refreshed picture data by compressing 20 
and coding said picture data by employing a re- 
sult obtained by said estimation means and for 
outputting said refreshed picture data. 

1 2. A moving picture transmission apparatus according 25 
to claim 1 1 , wherein said estimation means employs 

a motion vector search range for moving picture 
coding when making said estimation concerning 
said picture data portion. 

30 

1 3. A moving picture transmission apparatus according 
to claim 11 or12. wherein, for compression and cod- 
ing of moving pictures, said apparatus further in- 
cludes coded indication information memory means 

for storing, for each predetermined region, informa- 35 
Won concerning whether or not coded information is 
present, and wherein said estimation means em- 
ploys said coded indication information for estima- 
tion. 

40 

1 4. A moving picture transmission apparatus according 
to claim 11, 12 or 13, wherein said apparatus per- 
forms intra-frame coding for data for said picture 
portran that is determined, and performs inter-frame 
coding or intra-frame coding for all remaining pic- 
ture portions. 

15. A moving picture transmission apparatus, for com- 
pressing and coding a moving picture and for out- 
putting coded moving picture data, comprising: 50 

estimation means, for, upon receipt of decoding 
disabled range information concerning a pic- 
ture range of said coded moving picture data 
for which decoding is disabled by said decoding ss 
side, identifying a decoding disabled range, 
and for making an estimation as to which pic- 
ture data p>ortion by said decoding disabled 
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range is affected; and 

refreshed picture transmission means for gen- 
erating refreshed picture data by compressing 
and coding said picture data by employing a re- 
sult obtained by said estimation means and for 
outputting said refreshed picture data. 

1 6. A nKJving picture transmission apparatus according 
to claim 15. wherein said estimation means em- 
ploys a motion vector search range for moving pic- 
ture coding when making said estimation concem- 
ing said picture data portion. 

1 7. A moving picture transmission apparatus according 
to claim 15 or 16, wherein, for compression and 
coding of moving pictures, said apparatus further 
includes coded indication information memory 
means for storing, for each predetermined region, 
information concerning whether or not coded infor- 
mation is present, and wherein said estimation 
means employs said coded indication information 
for estimation. 

1 8. A moving picture transmission apparatus according 
to claim 15, 16 or 17, wherein said apparatus per- 
forms intra-frame coding for data for said picture 
portion that is determined, and performs inter-frame 
coding or intra-frame coding for all remaining pic- 
lure portions. 

19. A moving picture transmission system comprising 
picture transmission apparatus, picture receiving 
apparatus and picture correcting means, character- 
ised in that the correcting means include means for 
determining the portion of picture data affected 
when a picture frame is not correctly received by 
said receiving apparatus. 
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FIG.3 
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